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Abstract 

Engineering trade study analyses demand consideration of performance, cost and 
schedule impacts across the spectrum of alternative concepts and in direct reference to 
product requirements. Prior to detailed design, requirements are too often ill-defined (only 
“goals”) and prone to creep, extending well beyond the Systems Requirements Review. 
Though lack of engineering design and definitive requirements inhibit the ability to perform 
detailed cost analyses, affordability trades still comprise the foundation of these future 
product decisions and must evolve in concert. This presentation excerpts results of the 
recent NASA subsonic Engine Concept Study for an Advanced Single Aisle Transport to 
demonstrate an affordability evaluation of performance characteristics and the subsequent 
impacts on engine architecture decisions. Applying the Process Based Economic Analysis 
Tool (PBEAT), development cost, production cost, as well as operation and support costs 
were considered in a traditional weighted ranking of the following system-level figures of 
merit: mission fuel burn, take-off noise, NOx emissions, and cruise speed. Weighting 
factors were varied to ascertain the architecture ranking sensitivities to these performance 
figures of merit with companion cost considerations. A more detailed examination of 
supersonic variable cycle engine cost is also briefly presented, with observations and 
recommendations for further refinements. 
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% Prob. of Cost 


Aircraft Affordability Decomposition to Subsystem Models using 
the Process-Based Economic Analysis Tool (PBEAT) 
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Sample of Co-Variance Effect on Estimate Uncertainty & the 
Impact on Conceptual Design Studies 



This numerical experiment using Latin Hypercube depicts the offsetting effect of 
uncertainty for an increasing number of equally contributing submodels. 

These somewhat idealized results (statistically small sample, no bias in variance) 
demonstrate the large benefit modest decomposition and decreasing benefit 
afforded by the effort to create ever-increasing detailed submodels. " 
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PBEAT Application & Decision Analysis using NASA’s Subsonic 
Engine Concept Study for an Advanced Single-Aisle Transport 


► Engine configurations for a narrow body aircraft, similar to the Boeing B737 and 
Airbus A320, were parametrically studied by NASA. The following nomenclature 
identifies the engine configuration trade-space: 

• Hi = High work LPC 

• Lo = Lo work LPC 

• DD = Direct-Drive front Fan 

• G = Geared front Fan 

• FPR13 thru FPR17 = Fan Pressure Ratio 1 .3 thru 1 .7 

• FIXED = Fixed area fan nozzle 

• VAN = Variable Area fan Nozzle 

• Spiral-1 = OPR 32, Cruise Mach 0.80 

• Spiral-2 = OPR 42, Cruise Mach 0.80 

• Spiral-3 = OPR 42, Cruise Mach 0.72 

► Tile resulting 48 mission-sized engine/aircraft configurations were used to explore 
the cost-benefit of increased efficiency, reduced noise, and reduced emissions. 

► PBEAT Benchmark systems (Boeing 747, 777, 737, 787) calibrated using 
publically available data facilitated analogy estimating at the subsystem-level. 

Like the Benchmarks, more than 40 PBEAT attribute parameters were used in 
characterizing the trade space for each of the 17 subsystems. 
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PBEAT Application & Decision Analysis using NASA’s Subsonic 
Engine Concept Study for an Advanced Single-Aisle Transport 


► Outputs from the conceptual design/analysis codes (NPSS/WATE++, FLOPS, 
PDCYL) augmented by formulas for complexity drivers (detailed part count, 
design replication, etc.) were used to perform cost estimates using the PBEAT 
code. 
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PBEAT Application & Decision Analysis using NASA’s Subsonic 
Engine Concept Study for an Advanced Single-Aisle Transport 


► The abbreviated table below shows aircraft performance characteristics (noise, 
emissions, and flight time) and subsystem results of PBEAT cost analysis 
aggregated to the system level. 

► The cost results were later simplified by incorporating fuel usage and O&S cost 
into a single metric and subsequently expressing development cost, average unit 
production cost and O&S cost as a cost per flight hour. 


Spiral 

Configuration Name 

AUPC 

Mass 

DEV 

O&S 

FUEL 

NITROGEN 

OXIDES 

EMISSIONS 

Emissions 

LTO 

Noise 

Block 

Time 

SI 

HI DD FPR14 VAN 

$79,139,988 

99,820 

$3,329,688,170 

$20,192 

37,698 

198.9 

10.3 

254.3 

7.65 

SI 

HI DD FPR15 FIXED 

$52,985,977 

82,688 

$2,765,360,074 

$13,379 

33,612 

167.3 

9.6 

259.4 

7.64 

SI 

HI DD FPR16 FIXED 

$44,787,136 

77,690 

$2,571,631,395 

$11,245 

33,162 

158.2 

10.0 

266.3 

7.63 | 

SI 

HI DD FPR17 FIXED 

$40,408,688 

74,715 

$2,454,768,426 

$10,110 

33,336 

150.0 

10.7 

270.2 

7.62 S 

SI 

HI G FPR13 VAN 

$69,951,437 

95,537 

$3,077,493,312 

$17,908 

35,711 

203.1 

9.2 

247.8 

7.68 

SI 

HI G FPR14 VAN 

$54,326,144 

83,236 

$2,736,556,304 

$13,803 

33,897 

176.4 

9.7 

254.2 

7.63 f 

SI 

HI G FPR15 FIXED 

$44,611,238 

77,415 

$2,540,250,822 

$11,230 

32,449 

160.8 

9.3 

259.0 

7.64 | 

SI 

HI G FPR16 FIXED 

$41,694,784 

75,561 

$2,476,114,434 

$10,462 

32,880 

156.9 

9.9 

266.0 

7.63 e 

SI 

LO DD FPR14 VAN 

$72,767,228 

96,859 

$3,238,537,708 

$18,546 

36,352 

200.4 

10.7 

254.2 

7.65 | 

SI 

LO DD FPR15 FIXED 

$48,941,848 

80,492 

$2,670,278,851 

$12,333 

32,590 

176.0 

9.7 

259.3 

7.64 1? 

SI 

LO DD FPR16 FIXED 

$42,074,616 

75,927 

$2,487,306,567 

$10,542 

32,247 

168.7 

10.1 

266.1 

7.63 l 

SI 

LO DD FPR17 FIXED 

$39,140,849 

73,964 

$2,421,813,920 

$9,777 

32,606 

163.7 

10.8 

270.0 

7.63 S 

SI 

LO G FPR13 VAN 

$74,755,924 

99,773 

$3,222,159,921 

$19,168 

36,378 

219.0 

9.7 

248.2 

7.68 fi 

SI 

LO G FPR14 VAN 

$57,082,817 

85,386 

$2,830,344,270 

$14,524 

34,116 

186.0 

10.4 

254.3 

7.63 k 

SI 

LO G FPR15 FIXED 

$46,698,738 

78,986 

$2,598,211,661 

$11,774 

32,516 

175.3 

9.8 

259.2 

7.64 l 

SI 

LO G FPR16 FIXED 

$44,073,241 

77,379 

$2,554,601,379 

$11,075 

32,931 

172.4 

10.3 

266.2 

7.63 

i S2 
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$3,326,955,926 
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36,351 

262.9 

11.3 
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7.65 
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PBEAT Application & Decision Analysis using NASA’s Subsonic 
Engine Concept Study for an Advanced Single-Aisle Transport 


► The aircraft cost per flight hour provided a concise method for evaluating the 
varied engine design configurations in this direct Cost/FoM decision approach. 
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PBEAT Application & Decision Analysis using NASA’s Subsonic 
Engine Concept Study for an Advanced Single-Aisle Transport 


► A second decision approach was investigated using surrogate FoM “utility curves” 
and weighting criteria derived from the Analytic Hierarchy Process (AHP). 

► The basis of cost benefit in this approach allows for consideration of variation in 
value referred to as a Figure of Merit (FoM) utility score (worst within dataset = 0 
%*weighting score, best within dataset = 100%*weighting score). 
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Figure of Merit 



PBEAT Application & Decision Analysis using NASA’s Subsonic 
Engine Concept Study for an Advanced Single-Aisle Transport 


► The shape of each utility curve was derived from engineering judgment and 
warrants further investigation as to it’s impact on the decision results. 

► As related to cost, the first dollar of cost reduction is always easier to obtain that 
the last dollar of cost reduction and as such might be considered as having less 
value or utility. 

► As related to noise, the utility curve concavity shows less benefit for “over 
achieving” and also demonstrates the pitfalls of using combined FoMs (noise 
certification is regulated at 3 prescribed points rather than the overall cumulative). 



$ 55,000 $ 65,000 $ 75,000 $ 85,000 

Cost per Flight Hour 


FoM NOISE = -0.0002X 2 + 0.0396X + 0.6584 



11 


Distribution Statement A: Approved for Public Release 


www.nasa.gov 


PBEAT Application & Decision Analysis using NASA’s Subsonic 
Engine Concept Study for an Advanced Single-Aisle Transport 


► Cost weighted @ 25% 

► Emission weighted @ 25% 

► Block Time weighted @ 25% 

► Noise weighted @25% 

I The trade space plotted - Illustrating the 
Spiral 1 Hi G FPR15 configuration as the 
highest rated. 
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PBEAT Application & Decision Analysis using NASA’s Subsonic 
Engine Concept Study for an Advanced Single-Aisle Transport 


► Cost weighted @1 5% 

► Emission weighted @ 28.3% 

► Block Time weighted @ 28.3% 

► Noise weighted @ 28.3% 

I The trade space plotted - Illustrating the 
Spiral 1 Hi G FPR15 configuration as the 
highest rated. 

► With only slightly increased noise weighting, 
lower FPR engines begin to rise in utility 


FoM Cost = 15%, Emissions = 28%, Block Time = 28% & Noise = 28% 
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PBEAT Application & Decision Analysis using NASA’s Subsonic 
Engine Concept Study for an Advanced Single-Aisle Transport 


► Cost weighted @ 50% 

► Emission weighted @ 16.6% 

► Block Time weighted @ 16.6% 

► Noise weighted @ 16.6% 

I The trade space plotted - Illustrating the 
Spiral 1 Hi G FPR16 configuration as the 
highest rated. 

► With decreased noise weighting, higher 
FPR engines show greater utility (due to 
reduced ramp weight) 


FoM Cost = 50%, Emissions = 17%, Block Time = 17%>& Noise = 17% 
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PBEAT Application using NASA’s Engine Concept Study for a IQ- 

20 Passenger Supersonic Transport 


► Performance studies are underway examining the impact of variable cycle engine 
architecture for reconciling supersonic cruise performance with acoustically low 
takeoff jet velocity. 

► Using the same/similar tools as the previous subsonic example, a sparse pareto 
frontier was assembled from performance results of two engine architectures 

► For two of these engines meeting a desired jet velocity, engine cost estimates 
were generated at a subcomponent/part-level using the same attributes formulae 
derived for the previous subsonic example. 
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PBEAT Application using NASA’s Engine Concept Study for a IQ- 

20 Passenger Supersonic Transport 


► The sample results show the Average Unit Production Cost impact of two cost 
complexity drivers from these subcomponent results which have been aggregated 
to the component-level for comparison. 

► Results indicate generally acceptable results in applying “subsonic” attribute 
formulae to very different turbine engine architectures using PBEAT (though 
Turbines, and Controls & Accessories warrant further discussion/investigation). 

► Interrogation of subcomponent details highlights some areas requiring refinement, 
such as manufacturing processes assumed for the cooled turbine components 


CDFS Engine: Component-Level AUPC 
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CDFS Engine: Component-Level Part Count 



CDFS Engine: Component-Level Weight 
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PBEAT Application using NASA’s Engine Concept Study for a 10 

20 Passenger Supersonic Transport 


Refined formulae for variance (least, likely, most) on a subcomponent basis may 
be required rather than uniform +/- 10%, impacting cumulative distribution. 

Controls & Accessories is too broad a category in NASA’s current conceptual 
design (high part count overly inflates “off-the-shelf items), though large amount 
of electronics rightfully contributes to the high cost. 


Manufacturing processes need greater user specification using PBEAT (e.g. 
Turbine et al processes should be tied to conceptual desian code WATE++). 


CDF CDFSFANH-2AU PC Cost-Risk 



-CDFS FANH-2 AUPC 


Likely 


FANH-2 Duct & Inlet Guide Vane (Staged) 

$7,202 

$9,185 

$11,460 

FANH-2 (Stage#l) Stage, Shaft-drum & Rotating Seals 

$8,451 

$10,596 

$13,085 

FANH-2 (Stage#2) Stage, Shaft-drum & Rotating Seals 

$8,448 

$10,781 

$13,392 

FANH-2 (Stage#2) Stage, Casing Outer Wall (cooling) 

$13,630 

$16,964 

$21,217 

^NH-2(Stage#2] Stage, Stator, Case & Stationary Seals 

$16,143 

$20,428 

$25,561 

FANH-2 (Stage#2) Stage, Rotor, Case & Rub-seals 

$16,091 

$20,585 

$25,550 

FANH-2 (Stage#l) Stage, Casing Outer Wall (cooling) 

$16,693 

$20,956 

$26,134 

FANH-2 (Stage#l) Stage, Rotor, Case & Rub-seals 

$20,116 

$25,800 

$31,827 

^NH-2 (Stage#l) Stage, Stator, Case & Stationary Seals 

$20,174 

$25,881 

$32,397 

FANH-2 (Stage#l) Stage, Rotor, Disk 

$20,054 

$25,974 

$32,387 

FANH-2 (Stage#2) Stage, Rotor, Blades 

$26,769 

$33,902 

$42,528 

FANH-2 (Staged) Stage, Rotor, Disk 

$30,983 

$39,024 

$49,135 

FANH-2 (Stage#2) Stage, Stator, Vanes 

$31,090 

$39,494 

$49,491 

FANH-2 (Stage#l) Stage, Rotor, Blades 

$43,933 

$56,029 

$70,149 

FANH-2 (Stage#2) Stage, Blade Containment 

$57,611 

$73,214 

$92,767 

FANH-2 (Stage#l) Stage, Stator, Vanes 

$62,001 

$78,899 

$99,925 

FANH-2 (Stage#!} Stage, Blade Containment 

$77,491 

$97,553 

$122,551 

Sum Total = 

$605,266 



Sample of Controls & Accessories subcomponents 

ACC ACC Accessories Unit & Gearbox, HPC Tower shaft + Bearing/Sump 

ACC ACC Accessories Unit & Gearbox, Torque Converter (Customer Horsepower Extraction) 

ACC ACC Accessories Unit & Gearbox, Fuel Boost Pump (Electronic) 

ACC ACC Accessories Unit & Gearbox, Lube Pump (Mechanical) 

ACC ACC Accessories Unit & Gearbox, Electric Generator Unit 

ACC ACC Accessories Unit & Gearbox, Electric Starter Unit 

ACC ACC Accessories Unit & Gearbox, Fire Suppression Unit 

ACC ACC Propulsion Electrical, FADEC/ECUnit 

ACC ACC Propulsion Electrical, Electrical Wiring 

ACC ACC Propulsion Electrical, Lighting 

ACC ACC Propulsion Electrical, Sensors 


Sample of Variable Nozzle subcomponents 

NOZ-15 NOZ-15 Nozzle (Bypass), Outer Wall Panels & Stiffeners 

NOZ-15 NOZ-15 Nozzle (Bypass), Convergent Inner Wall Panels & Stiffeners 

NOZ-15 NOZ-15 Nozzle (Bypass), Divergent Inner Wall Panels & Stiffeners 

NOZ-15 NOZ-15 Nozzle (Bypass), 2D Sidewall Panels & Stiffeners 

NOZ-15 NOZ-15 Nozzle (Bypass), 2D Transition Panels & Stiffeners 

N OZ-15 NOZ-1 5 VAR AREA C & A 

NOZ-15 NOZ-15 VAR AREA MISC 

NOZ-15 NOZ-15 Nozzle (Bypass), Plug Panels & Stiffeners 

NOZ-15 NOZ-15 Nozzle Thrust Reverser (Bypass), Clamshell Frames & Skeleton 

NOZ-15 NOZ-15 Nozzle Thrust Reverser (Bypass), Reverse Flow Chutes 

NOZ-15 NOZ-15 Nozzle Thrust Reverser (Bypass), Crank &Linkage Arms 

NOZ-15 NOZ-15 Nozzle Thrust Reverser (Bypass), Nozzle Outer & Inner Panels Lap Seals 

NOZ-15 NOZ-15 Nozzle Thrust Reverser (Bypass), Actuation 
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PBEAT Application using NASA’s Engine Concept Study for a IQ- 

20 Passenger Supersonic Transport 


► 

► 


► 


The general ranking of Fan subcomponents costs are as expected. 

Fan containment, though a complex Kevlar material system, has excessive 
production cost prompting more refined specification of manufacturing maturity in 
the supplemental formulae. 


Similarly, highly variable components, such as the vanes, exhibit excessive 
production cost and warrant investigation (corroborated by highly variable nozzle). 



Cases, shaft 
drums, seals 


-s 


FANH-2 (5tage#l) Stage. Blade Containment 
FANH-2 (Stage# 1) Stage, Stator. Vanes 
FANH-2 (5tage#2) Stage. Blade Containment 
FANH-2 ( Stage# 1) Stage, Rotor, Blades 
FANH-2 (Stage#2) Stage, Stator, Vanes 
FANH-2 (Stage#2) Stage, Rotor, Disk 
FANH-2 (5tage#2) Stage, Rotor, Blades 
FANH-2 (Stage# 1) Stage, Rotor. Disk 
FANH-2 (Stage#l) Stage, Stator, Case & Stationary Seals 
FANH-2 ( Stage# 1] Stage, Rotor, Case & Rub-seals 
FANH-2 (Stage#l) Stage. Casing Outer Wall (cooling) 
FANH-2 (Stage#2) Stage, Rotor, Case & Rub-seals 
FANH-2 (Stage#2) Stage, Stator, Case 8t Stationary Seals 
FANH-2 (Stage#2) Stage, Casing Outer Wall (cooling) 
FANH-2 (5tage#2) Stage, Shaft-drum & Rotating Seals 
FANH-2 (Stage#l) Stage, Shaft-drum & Rotating Seals 
FANH-2 Duct & Inlet Guide Vane (Stage#0) 


CDF5 Engine FANH-2 Component: Avg Unit Prod Cost 



$57,611 1 

$73,214 

1 


$ 56,02 

| 570,149 


$ 39,024 


$33^02 


$20,054 
$20,174 
$20,116 
$16,693 | 
$16,091 | 
$16,143 ■ 
513.630 


$31,090 
$30,983 
$26,769 

11 $32,38! 
11 $32,39; 
| $31,827) 
| $26,134 
| $25,550 
| $25,561 
$21,217 


$49,491 

$49,135 


$8,448 
$8,451 | 


I $13,3? 2 
$13,085 


$7,202 ■ $11,460 


Least 


l Most 
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Summary Observations 


► No cost estimate is “right”, though some techniques are better than others. Cost 
confidence and managing to cost are what matters most, and requires integration 
with conceptual design tools where -70% of cost-impacting decisions are made. 

I Estimates aggregated from decompositions deeper than 2 or 3 levels below aren’t 
worth the time and effort to create them (co-variance argument). Furthermore, 
decompositions without some accompanying engineering for complexities (e.g. 
TRL, manufacturing maturity, etc.) can confuse results and undermine cost 
confidence (witness “Fan Containment” and “Controls & Accessories”). 

I Decision Analysis is not a robot optimizer. Robust, flexible solutions are better 
than true optimums, especially during conceptual design phases of a program 
when requirements and engineering uncertainties are greatest. 


Demonstrated versatility of PBEAT is suited to NASA’s broad charter (aeronautical 
systems, space launch & satellite systems, green energy, etc.). 

• Refinement of supplemental formulae (attribute characterization) continues, to better address Turbine 
Engine specifics and enforce user-consistency without degrading PBEAT versatility 

• Automated linking between improved fidelity Aircraft/Engine design codes and the PBEAT code (via 
autodata sheets) continues to reduce estimation time/effort and accelerate cost as a decision criteria. 
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